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INIRGOUCTION 


The purpose of reorganization is to allow the user to alter the 
physical and/or tlogical description of an existing data base» 

with maximum system assistance in the restructuring of the data. 
base yet with.a minimum impact on user programs which reference 
the data base. | | eu 2 


The UPLATE capability first provided in the 6.0 releases allows 
the user toe add or delete structures from the database as long as 
it requires no restructuring cf the continuing database. The 
only affected programs are those programs which use deleted 
information or desire to use the new information. These programs 
have to be changed and recompiled. | ; ee 


To use the UPDATE capabilities» the user compiles a description 
of the new data base. This description is preceded by an SUPDATE 
cards to indicate to the Data and Structure Definition Language 
“CDASDL) that this is an existing database and a comparison of the 
old and new descriptions is required. As tong as the differences 

between the two descriptions satisfy the rules of legat changes» 
then the new dictionary and library files supersede the old ones. | 
No changes are made to the database. The version stamps of atl. 

existing structures are unchanged so that user programs are 
unaffected untess they access deleted structures» in which case 
they get a VERSION ERROR when they attempt to open the database. 


The reorganization capability atlows the user to redescribe the 
database (with any implicit physical or logical changes) and/or 
to explicitly request that special reorganization functions be 
performed on the database. oe oe 


Reorganization is accomplished by first running - a ODASOL 
compilation with a SREQRGANIZE card and the redescription of the. 
database and/or requests for special reorganization functions. 
DASDL produces a special reorganization control file which 
describes the particular changes that must be made to the 
database to accomplish the reorganization. ODASDL then makes 
copies of the reorganization programs» binding them to this 
particular database and appending a OMS path dictionary. The. 
user executes these speciat copies of the reorganization 
programs» which then accomplish the reorganization process. 
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READER AND WRITER PROGRAMS — 


There are | two recraanization programs» the — reader 
COMS/REORG.READ) and the writer COMS/REORG.WRIT). 8oth are 
written tn SDL. When DASDL copies and binds these programs to 


the particular database» it also changes the names to <database 


name>/REORG.READ for the reader and to <database name>/REORG.WRIT 
for the writer. Reorganization is actually initiated whenever 
the usé@r desires» by executing the reader. The reader. 


ziptexecutes the writer» extracts the information in the old 


database» using the MCP access routines in most instances (via. 


the COMMUNICATE operator)» and then places this information in a 


queue file. The WRITER program accepts the information from the 


queue file and places it into the new database using» in most 


instances» the MCP access routines. At the coepletion of the 
reorganizations the new database dictionary is marked to indicate 


that the new database is valid and the oid database dictionary is 
removed. , | | 


If a lack o f memory or disk space prectudes these two programs 


and the two databases from being active at the same time» then 
tape may be used as the intermediate medium instead of the queue 


file. This is requested by inctuding a STAPE card in the DASDL 
compilation. The two programs will then execute seriatly>» 
instead of the normal simultaneous execution.e Disk may also ke 


used» by OQU-ing the tape file to disk at run time. 


If any DMS exception occurs during the execution of either of 


these two programs (e.go» if duplicates are not allowed on a new 


set and the data tin the old database inctudes duplicates)». then 


the reorganization witi terminates the new database will be 


- marked unusab le and the old wilt be marked as vatid (but not 
| reorganized). | | 2 


If reorganization accesses corrupted data from the old database 
or if reorganization aborts Cprogram failure or system failure)» 
then the old database may become unusable (see ABNORMAL 


CONDITIONS section). For this reason» it is advisable to dump. 


(copy) the entire database before running reorganization. © 
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AUDIT and RECOVERY will be unabte to operate ripouch: an UPDATE or 
a reorganization. For this reason» and for backup» the entire 
database should be saved after a reorganizations also. 
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“DATA QASE REDESCRIPTION RULES 


The following rules identify those changes that may be made when 
redescribing a database for reorganization. Rules marked with an 
asterisk (*) require a version stamp change and the necessary 
recompilations (see VERSION CHECKING section). Further 
information on rules 1 through 8 is in the DATA TRANSFORMATIONS 
section. | | nt 


*1. Items may be added to existing data sets (fixed or 
variable format parts). These new items may be used as 
key items or may be required AY 1f an initial vatue | 

was specified. | : _— 


*2. Items may be deleted fede existing Gata sets (fixed or 
variable format parts). 


£3, Items sizes may be increased or decreased. This 
includes both the fraction and integer part of numbers. 

(Key items of ordered manual subsets may not be 
changed. ) a | 


the) Signs may be added or dropped on numbers. (Key items 
| of ordered manual subsets may not be changed.) 


#56 Occurences may be increased or decreased. 


*6. Item types may be changed. (Key items of ordered 
: manual subsets may not be changed.) 7 , tS ee 


a7. Groupings and/or levels may be changed. The items must 
be used within the scope of the same data sets in the 
old and the new database. 7 ea 


*B. items may move fron the fixed foraat part to a variable 
| format pars and visa- versa. 


«9. The ordering of the. items may be changed. 
19. -$ets and automatic subsets may be added. 
*11. Sets and automatic subsets may be deleted. 
12. Sets arid autoeetse subsets may change their “duplicates — 


clause. 


(*13. Sets and automatic subsets key ttems may be changed. | 


~ 
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*14,. Sets and automatic subsets ascending and descending way 
be changed. 
*15. Index sequential sets may be changed to. index random. 
- sets or automatic subsets. | | 
*16. iaaes random sae. may be changed to index sequential 
‘sets or automatic subsets. 
#17. Automatic subsets may be changed to sets. 

18. Embedded data sets and manual subsets may be added. 
*19. Embedded data sets and manual subsets may be deleted. — 
*20 ‘Ordered data sets may be changed to unordered. 
w21e Unordered data sets may be changed to ordered. 

#22. Manual subsets with keys” may be changed to manual. 
subsets without keys. | | Co 

23. ALL of the physicat attributes may be changed. These 


include: 


PRIME. 


MAXENTRIES 
MAXRECORDS 
TABLESIZE 
MODULUS 
BLBCKST ZE 
ARE ALENGTH 
SPLITFACTOR (reorganization not required) 
AREAS 
FAMILYNAME 
TITLE | 
SECURITYTYPE 
SECURITYUSE 


A TITLE in the old database may only be used in the new 


database for the same file or for a file that is being 


epOrgenl zee 
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#24, The conditions for automatic subsets may change. 


256 The conditions for VERIFYS may change. 


Note: The comparison on conditions is_ for an 
equivalent expressions not for an identical 
expression. | 
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DAIA IRANSEQRMATIONS 


During reorganizations data items within a data set may change in 
size» type» offset and number of occurrences» subject to certain 
restrictions which are discussed below. 3 


Data items may be added or dateted from the description ae a data 
set. When a data iten is deleted» the data associated with that 
item is removed from allt records in the data set. Khen a data 
item is added» a data field containing the initial value of the 
data items if specified or nulls» is inserted into alt records in 
the data set. Items which are added and do not have an initiat 
value spect fied may not be used as keys or be Feaewnee fields. 


Data item sizes may be changed. lf the old size is greater than 
the new sizes then data will be truncated from the item. This 
condition is detected by DASDL and a warning message is given. . 


Data items may add or delete the sign field. Deletion of the 
sign field is detected by DASDL and a warning message is given. 


CCCURS nesting may go to three tevels in DASDL.~ $A data ttem'’s 
number of levels of nesting may change. A data ites's number of 
occurrences may changee > If the number of. occurrences changes 
without changing the number of tevels» then each level is 
preserved and each subscript remains as it was. If the number of 
occurrences decreases in the new database, onty the first on 
occurrences wilt be moved to the new records where n is the 
number of occurrences of the data item in the new data set 
record. This condition is detected by DASOL and a warning) 
message is given. If the number of occurrences increases in the 
new database» only the first m occurrences will have data moved 
into them from the old data set record» where m is the number of 
occurrences of the data item in the otd data set record. 


In transforming PERSON from database A to database B in Figure 
S-i> the transformation would be as shown in Table 31a» - and 
there would be three stots in database 8 without valid data. 
Going from B to A» three occurrences of PERSON would. be lost and 
a warning message would be given. 


iif the number. of iouetsehengees as from database A to javabase C _ 


in Figure 3-is then the structure is recreated Linearly and the 
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old subscripts may have no relation to the News an the mapping 
a oun in Table 3-1b. 


JOB GROUP OCCURS 3 TIMES. 
a ¢ @® @ 8 


PER SON ALPHA C10) OCCURS ? TIME S3 


eee mF 


Figure 3-1la: Example database A 


JOB GROUP OCCURS 3 TIMES 
{ dian 
PERSON ALPHA 10) OCCURS 3 TIMES 


eee )> . 


Figure 3-ib: Example database B 


JOB GROUP OCCURS 2 TIMES 
i wee 
JOB ORDER OCCURS 2 TIMES 
{ aoe 
PERSON ALPHA (10) CCCURS 2 TIMES? 


eos) 
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Figure 3-1c: Example dat abase C 
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7 8B | : A C- 
~~ Cleld = C1»l) | Cleld- CLislsl) 
Clie2) (12) | Circ) Clele2) | 
saat (1,3) , : = (201) CL 2@eL) 
C201) (€201) | . C202) C1222) 
C292) (22) ; | C301) C€20191) 
=< C23) | C392) (20152) 
(391) (31) | | | | lt C2201) 
(35?) (392) | ; 723° (C2 2e2 ) 


Table 3-ia: Mappings of PERSON between Figure 3-1b databases 


The grouping anaror levels of data items may be changeds subject 
to the following restrictions: a 


le kegrouping of items may not cause data to be 
- duplicated. For example: a 


oid : a | new 

A GROUP A ALPHAC2)3 
CB ALPHACLD3 | B ALPHAC1)3 | 
C ALPHACLO Ds r+ ae ALPHACL D> — 


is forbidden. In this examples the Gata represented ‘oy 
A are duplicatec in the new definition» since B and C 
both contain data contained In the new Ae 


2e kegrouping of items way not cause multiple mapping of 
information into an item. This would occur if the new 
definition were transformed inte the old definition in 
the example above. - % 


Item types may be changed. The only restriction imposed here is 
that a decimal or signed decimal item may not be changed to be an. 
elementary alpha item (this is a COBOL rule). 


hen DASDL detects that an item must be transformed» tt 
effectively generates a MOVE which conforms to the. COBOL 
conventions. — | | , : . , 
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truncation or ee. ff 3 | 


space {zero tzeroitrunc-tgenerateltrans- 


fill Fill Ifitticate Ipositivellate 
eS Sa eee a ee meee “On i on ! on isign. | sign | 
FROM 1 TO l right ftrighttitefti ! | 1 
S255 So 5 5 25 S255 543552) SS S522 (esses (sees lass = See Se Se Se ft Se SSeS 
{ i i ! i ! 4 
group i group i x t ! i { { 
group 1! atpha ix j i d f i 
group ! integer. 1 a oe i i ix 
group i signed tnt.l i ex | 1 i Xx x: 
group § decimal { fx. f { d re aes 
group ! signed dec. ox 43 i i x 4 
elekehatatetetetatel belatatetetatatetatatel letebatetatatel Retetatated betatatel Raletatatel Ratetetetetatatel Ratetedetete 
alpha — ) ogrouo | Xx i { : 1 1. 
alpha. ft aloha | | X i i i 1 i 
alpha 1 integer {4 =n i .x« i ; ' x. 
alpha | signed intel j t ox«f 1 x i .x 
alpha i decimal i i i x i ' { x 
alpha © |} signed decel { 1 »xf { x |. x 
siabatahaicetetatatel Ketetatetetetatetetatated Retatatetatetel Katetatated totatated Getetetatel Ratatetetatatetel Ratetetetete 
integer 1 group ! x i j 1 i i x 
integer i alpha { x i i i ! $$ YX 
integer 1 integer i i i x i i i 
integer 1 signed tnt.! i ix] { 4 { 
integer 4 decimat a I i xf ' q 
integer ! stgned dec. 4 i xt. f -¢ { 
aiallatatatatateatatad Ratatat betatetatetatatel atelateietetel Ratetatated taketetel Relatatekel Ratetelatetatsted Retetetetate 
signed int.! group ix 1 a ae | i x 
signed int»! alpha i x i i b§& x 4 to xX 
signed int.! integer j t box tf x | 4 
signed int.! signed intet { bx bo ¢t i 
signed inte? decimal : i if x § x Ff i 
signed int.! signed dec.! { 1 x i 4 4 
aleteaatabetatateted Reketetetehetetetetatatel Reletatetatatel Retatateded Keletated Retetetetel tatelnletatettel Retetetetate 
decimal i group { x | i d i i 
decimal i aloha  feerrorel f i { { 
deciaal. J) integer f | tx i i i 
decimat $f sijned int.! i i ox ft i x { 
decimal $1 decimal i i i oxi i ee 
decimal i signed dec.i i i x 1 i x i 
i lolekatatelat attend Kolatatetntatetatelatated Ratataledatatel Retatateied atetated Ratetatetel Ratetetetatetatel Retetatatet 
signed dec.1 group { X { j i x | j 
Signed dec.! alpha  {*errors| i i j 1 
signed dec.! integer 1 i i x. i x 3 1 
signed decel signed inte! i i x i | i 
signed dec.! decimal 4 i i xi x t to 
signed dec.! signed dece! i. i xt { 4 | 


Table 3-2: DASDL MOVEs (COBOL Conventions) | 
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If an item is moved from the fixed format part to any variable 


format parts» the contents of that fietd wilt be lost in att 
records not containing the specified variabte format parts. A 


— DASDOL naeniN: wilt be given to indicate the potential less of. 


data. 


If an ttem is moved from any variable format parts to the fixed 
format parte that item will be set to initiat values if specified 


or to null in att records which did not contain the specified 
variable format parts. 


If variable format parts are eliminated» there can not be any 


records in the database which contain that variable format part» 
otherwise a data error exception witt occur during reorganization 


and the reorganization witli fait. 
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VERSION CHECKING 


Each structure and remap has associated with it a version stamp 
which reflects the Latest time that a change was made to the. 
logicat descrintion of the databases that would affect any 
programs which use that structure or remap. Any programs 
containing descriptions of a structure or remap with a different 
version stamp will get a version error when the database i15s 
opened. A reconpilation of the program is required to bring it 
up to date with the current description of that structure. This 
recompilation must take pitace after the successful completion of 
the reorganization process. The version stamp of a structure or 
remap is contained in.the LIBRARY file which describes its the 
LIBRARY files are not generated until the successful completion 
of the reorganization. Note that whenever a structure is 
deleteds its version stamp is changed. : 


Some of the changes that are tlegat with reorganization wilt 
require that the version stamps of some of the structures or 
remaps change. The user should be aware of any changes requiring 
recompilation and the magnitude of the recoaupitation effort. 
requireds before making any changes to the database. All of the 
reorganization rules marked with an asterisk (*) under Data Base 


Kedescription Rutes will require a version stamp “ienar and the. 
necessary recouptlatrons. 
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SPECIAL REGRGANIZATION FUNCTIONS 


Special reorganization processing against the database ‘may. be 


requested by the user. There are two types of these functions: 


GENERATE and PURGE.  $=These special functions are requested by 
including explicit reorganization statements in the DASOL source. 
These statements may be the onty source input to the CASDL 


compiler or they may be inctuded with a redescription of the 


database. In the tatter cases the exolicit reorganization 
Statements must appear after the pateoese redescription. 


‘GENERATE STATEMENT 


During the normal updating of a databases the efficiency of the 


database may deteriorate both in terms of the amount of I/06 


required to access parts of the database and the asount of eee a 
disk space. 


The GENERATE statement causes the reorganization prograas to 
rebuitd structures in the databases restructuring them to. 


increase their efficiency and “garbace cotlecting™ excess disk | 
space. . : 


All structures return unused disk space to their available 
storage tist. Howevers there 31S no mechanism for returning 


unused file areas to the systen. Thus» af ao$structure at 


sometime included a very large number of records and subsequently 


returned to a more typical size» none of its unused physical 
areas would be returned to the system. The space would be 


available to that structure but may never be needed. A GENERATE 
on a structure causes the reorganization process to “compress” 
the structure and return unused file areas to the system. 


A GENERATE on a structures besides "cgarbage coltecting™ unused 
Spaces causes the reorganization process to rebuild =the 


structures restoring it to a more efficient state. The specific 


effect on the structure and improvement in its efficiency is. 
dependent on the structure type. | 3 
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Syntax: 

GENERATE ~~ <structure nane> eee 


{ fete | a | > i 
1_ CFAMILYNAME = <reorg-pack-id>)_! 


2emantics: 


A GENERATE on a data set causes the reorganization process to 
read the data records in their physical order and store them into 


the nen database. This also causes an implicit pee Ne le on all 


sets or subsets which reference the data set. 


A GENERATE statement on a manual subset causes the reorganization 


‘Process to do a find for each entry in the ofd database and an 
insert for each entry in the new database. In this way» manual 
subset entries which point at dead records or at records whose 


keys have changed will be eliminated from the database. Howevere | 


an implicit GENERATE. only causes a balance to be done on the 
manual subsets and the addresses of the object data records to be 


adjusted. In this casee those entries which point at. dead 
records are eliminated» but no check is made for matching key. 
values. | | | - 
A GENERATE on an automatic set or subset causes the 
reorganization process to perform a batancing operation on the 
structure. The old structure is read by the reorganization 


programs and the tables are restructured according to the 
SPLITFACTOR and MAXENTRIES attributes. If the object data set is 
also being reorganized» the addresses of the object data records 
are also adjusted. © | | 


A GENERATE on an embedded data set or manuat subset will Cause an 
implicit generate on the parent data set» with the exception of 
an implicit GENERATE on a manuat subset which only causes the > 


manual subset 's structure heads to be adjusted in the parent data 
| set records: | : = | | 


eae ae 
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A GENERATE on an embedded structure will cause groups of records 
with the same parent record to occupy contigious blocks. . 


The optionat FAMILYNAME clause attlows the user to specify an 
alternate media for the GENERATEd structure. Alt intermediate or 
temporary files used in the reorganization process for this 
Structure wilt reside on the pack specified. See the section on 
FILE NAMING CONVENTIONS for more details. | | | 


Syntax: 
GENERATE --~ <disjoint data set name> =------ aaa rr 
>>== CROERED BY -- <ordered set> sree nre nnn nn nnn nner nnn nn nn nnn nnd 


| | | | | 
1_ CFAMILYNAME = <reorg-pack-id>)_! 


Semantics: 


This variant of the GENERATE statement is the same in all regards 
except that the data records will be read in the order of the 
ordered set rather than in the data set's physical order. The 
ordereu set must exist in the old database. | 


PURGE STATEMENT 


The PURGE statement is the means by which the user may request 
that the reorganization process remove alt records from a data 
-$ete break all relatitonshios that have been established for a. 
manual subset or recreate an automatic set or subset. A PURGE 
may be thought of as a detetion and addition of a structure where 
the newly added structure has the same structure number and 
version stamp as the deleted structure. It should be noted that 
 @ PURGE takes precedence over all other reorganization functions. 


Syntax: 


PURGE coseceseen== <structure name> cocrmetetn este 5 teen een 
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Semantics: 


A PURGE of a structure causes its file to be reinitialized and 
ali information to be removed from it. When an embedded 
structure is PURGEd and its parent structure is not PURGEd then | 
the embedded structure's structure head is set. to nutt in the 

parent data record. | 


A PURGE of a data set causes an implicit purge of atl its 
embedded structures and all sets and subsets which Perera nce ite 


When an automatic set or subset is PURGEd and its object data set 
7S not PURGEd> the reorganaization process rebuilds tt from the 
data in the object data set. This is different from a GENFRATE> 
in that the GENERATE causes ‘the reorganization orocess to rebuild 
the set from itself. 
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“EILE=NAMING CONVENTIONS 


The reorganization programs generate a number of temporary disk . 
files that are used during the reorgaization of a database. The 
user should avoid naming his files in such a way as to. conflict 
with the names of these temporary files. 


A temporary copy of the database dictionary has the name: 
Ranwabace pack>/#<new database name>/DICTIGNARY. 


The <database pack> and <new database name> come from the compile. 
card of the DASOL compilation. : 


If the REORG. READER and REORG.WRITER are run simultaneously, they 
communicate via two queue fites: 


<old database name>/REORGG and 


<old database name>/ERRQ 


There are five different — eve ef temoorary fites that wey be 
used for a structure in the data base: | 


1) <reorg pack id>/#<new database ‘name>/#REORG?<structure number > 


This file is used for structures which are rebuilt by the system. 


2) <reorg pack id>/#<new database name>/#FIXUP:<structure number> 


This file is used for structures which are rebuilt. by the 
 ceorganization routines. | | 


3)  <reorg pack id>/é<new database name>/#A-XRFi<structure number> 


This fite is an address cross-reference for data sets which are 
reorganized. | 7 : | 


4) <reorg pack id>/#<new database name>/#XAREA:<structure number>. 
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This file 7S. used to facilitate. ehanatnu the number of areas of Aa 
structure. 


5) <reorg pack id>/#<new database name>/#SORT:<structure nuxnter>. 


This file is used to sort the keys of an index random structure 
which is being converted from the old table format to the new 


table format. 


The <reorg pack-id> is taken from the FAMILYNAME clause on the 
GENERATE statement. If no <reorg pack-id> has been specified for 
this structure then the structure!s pack~id in the new database 
wiitl be used. 


When the REORG.READER and KEQRG.WRITER are run serially» disjoint 


data hierarchies are passed from the. REGRG.READER to. the 
REORG.WRITER via a tape file. These files have the name: 


<old database name>/#DATAQ?<structure number> 


where the structure number is that of the disjoint data set. 


ALL temporary files are removed automatically by the REORG.WRITER 


at the end of the reorganizaticn process» along with atl files in 


the old database which are not part of the new database. . 
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ABNORMAL CONDITIONS 


Certain abnormal conditions may cause the reorqanization. to 


terminate prematurety. When this occurs the user needs to 
ascertain if the reorganizatian process is restartable and if 
not» what action must be taken to restore the existing database 


to its ofete orior to initiating the reorganization. 


ces aiactuaiiiun of the reorganization may be initiated externally 
Cprogran DSeds» Clear/Start» etc.) or internally. When internatty 


Initiateds the reorganization programs witt notify the user 
whether or not they may be restarted. In general» when the. 


termination is externally initiated» the reorganization is 
restartabte. | | - | 


The reorganization process has two phases. In the first ohases 
no modification is made to the existing database. In the second 


phases the reorganization will removes modify» and add files. If 


the reorganization terminates in this second phase and the 


reorganization is not restartabler the user should reload his 
backup copy of the database before rerunning the reorganization 
or continuing processing on the existing database. The user can 


identify which phase the reorganization was in by tnspecting. the 


output from the reorganization programs. Tf that cutput is not 


available (when the reorganization terminated because of a 


Clear/Start) the SPO output maybe inspected for the Bonner, 


"a eee BEGIN FILE MODFICATION he tee 


This message indicates that the Pore ana et process fas begun 


the second phase. 


A certain class of nonrestartable errors occurs because of an 
improper specification of the database to DASOL. Possible errors 
of this type are? — : | 


-- duplicates which occurred but. were not specified as 


allowed in the new database. 


-- a Limit error on aé*fite in the new database (OeGer 
maximum level of coarse tables exceeded» file size. 


exceeded). 


-- a data error because of failure to meet WHERE or VERIFY. 


Bassey 
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‘conditions specified in the new database. 


“- attempts to reduce the number of areas in a file below 

| the maximum area number that has space allocated 

(occurs when only the number of areas is changed on a 
file>. 3 


If the output from the reorganization process indicates that it 
terminated because of one of the errors listed above» the user 
must correct his ODASOL specifications before rerunning the 
reorganization. | 
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ALGORITHMS 


‘The DMS subsystem of the MCP is used for uch ‘of the 


reorganization processing. However » there are several special. 


algorithms implemented in the reorganization programs to provide 
functions that are not available in the DMS subsystem» or. to. 
provide speed benefits for frequently used functions. | The 
details of these algorithms are explained below. | | 


Indexed sequentiat is one of the special functions. — The 
algorithms used in the DMS subsystem attempt to build and 
dynamicatly maintain a balanced tree structures _ however», 
additions and deletions tend to unbalance the tree structure. 


The balancing function reestablishes a balanced tree. It uses as 


inputs the tables buiit by the oS Snore 


a ane loaded in order into the fine table until the fine. 
table is splitfactor full. The key of the last entry,» together 


with the address of this fine tables is then propogated up to the | 
first tevel coarse tabie. The coarse table is also filled to 


splitfactor» and when that size jis reached the tast key and the | 
table address is propogated up to the next tevelt coarse table. 
New fine and coarse tables are allocated as necessary. When alt 
entries are loaded into the fine tables» the tast key of the last. 
fine table Catl bits on) is propogated up through alt existing — 


levels of tables. The root table pointer is set to the highest 


level coarse table. During the process of filling tables» each 


tevel of tables are tinked together in Logical order by a next 


and prior pointer. 


Manual subsets are treated as a special case. If a data set to 
which a manual subset refers is reorganizeds then the addresses 


of the manual subset must be corrected to reflect the new. 


locations of the data records. Garbage-collection of the list 
structure is performed while correcting the addresses. 


The parent records of the manual subset are accessed in physical 


sequence. As each is accessed» its entire manual subset is 
processed. First» there is a check for a fast subset (manual 
subset with one element and no key). If one is founds then the 


address which is kept in the list head of the parent is corrected 


and the algorith® moves on to the next parent. Otherwiser the 


list tables are retrieved in a sequence determined by the list 
control information of the list tables. Each entry is taken from 
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rhe ota list» its address ts corrected» then it is entered into | 
the new fist. The new tist is compacted and all space for 
deleted entries in the otd list are removed by combining the 
entries from multiple old tabless until a new table is filled. | 
The tist head in the parent record is adjusted to reflect the new 


List.. Because the new list is built starting from the parent 
records the new List will have all the tabtes from a parent 


contiguous» to take advantage of blocking and to minimize arn 
movement. | | _ 


Each time an address correction is made» the address is checked 


to ensure that the referenced record is still valid. If the old 
address points at deleted records» 7EneO those list elements are 


not entered into the new list. This process results in new files 
for both the parent structure - and ene manual subset. | : | 


If a manuat subset 1s reorganizeds then the DMS access routines 
within the MCP. are used to read the old tist and build a new. 


If anew set or automatic subset is added to an existing data 
set, then the DMS access routines in the MCP are used to buitd 
the ner tndex. Firsts the structure records are adjusted to 
indicate that onty the new index is to be built» then the 
reorganization uses the NCP access routines to rebuild the set. 
At the completion of the operation» the structure records are 
corrected. | 7 oe 


Another special function is the routines which convert pre-8. 
index sequential and index random structures to the 8.0 format. 
These routines cannot be calied directly by the user. They are 
used ty DASDL when the user requests a conversion of a pre-8.f 
database to BeGeo The conversion orocess requires a 
reorganizations however the change to the new format indexes is 
the onty process which will eccur during this reorganization. 
The user may not request any other reorganization during this 
execution. 7 a pee 
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